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(54) REAL 3-D MODEL FORMING DEVICE 



(57) An apparatus capable of quickly obtaining 
three-dimensional shape data by scanning a target with 
light projection. A plurality of images of the target is ob- 
tained using a camera at a data input section (10). 
Three-dimensional shape data including color data at a 
modeling section (1 2) is then obtained based on the plu- 



rality of images, and a real three-dimensional model is 
formed at a formation section (14) based on the three- 
dimensional shape data. The formation is done by mill- 
ing or using a formation mold. Color processing is ap- 
plied to the real three-dimensional model based on the 
color data by a coloring process section (16). 
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Description 

Technical Field 

[0001] The present invention relates to a real three- 
dimensional modeling apparatus for capturing a target 
and producing a real three-dimensional model of the tar- 
get. 

Background Art 

[0002] For years, various types of three-dimensional 
scanners which can be used to obtain three-dimension- 
al shape data of various types of objects have been 
known. Engraving machines which are driven based on 
the three-dimensional shape data are also available. A 
three-dimensional shape model can be produced using 
such an engraving machine. 

[0003] A system is known in which three-dimensional 
shape data of a target such as a person or a statue is 
obtained by irradiating laser ray on the target and pro- 
ducing the target using the engraving machine based 
on the data. 

[0004] However, when scanning a target using laser 
ray to obtain the three-dimensional shape data, the tar- 
get must not move while being scanned. However, be- 
cause scanning requires a relatively long period of time, 
it has been difficult to obtain three-dimensional shape 
data for a human being. 

[0005] Moreover, there is another problem that irradi- 
ating strong laser ray onto a person introduces a number 
of safety concerns. 

Disclosure of Invention 

[0006] The present invention is conceived to solve the 
above described problems and one object of the present 
invention is to provide a real three-dimensional mode- 
ling apparatus which is capable of effectively producing 
a real three-dimensional model. 
[0007] In order to achieve the objects described 
above, according to one aspect of the present invention , 
there is provided a real three-dimensional modeling ap- 
paratus comprising an input section for inputting three- 
dimensional shape data of a target and a formation sec- 
tion for forming a real three-dimensional model from the 
obtained three-dimensional shape data, wherein the ap- 
paratus produces a real three-dimensional model. 
[0008] According to another aspect of the present in- 
vention, there is provided a real three-dimensional mod- 
eling apparatus comprising a data input section for in- 
putting image data by capturing a target from a plurality 
of directions: a modeling section for generating three- 
dimensional shape data based on the plurality of ob- 
tained image data; and a formation section for forming 
a real three-dimensional model based on the obtained 
three-dimensional shape data, wherein the apparatus 
produces a real three-dimensional model. 



[0009] According to another aspect of the present in- 
vention, there is provided a real three-dimensional mod- 
eling apparatus comprising a data input section for cap- 
turing a target and inputting image data including color 
5 data; a modeling section for generating three-dimen- 
sional shape data and associated color data; a forma- 
tion section for forming a real three-dimensional model 
based on the obtained three-dimensional shape data; 
and a color processing section for coloring the obtained 
real three-dimensional model based on the color data, 
wherein the apparatus produces a colored real three- 
dimensional model. 

[001 0] According to another aspect of the present in- 
vention, it is preferable that a plurality of image data in- 
cluding color data are input. 

[001 1] According to another aspect of the present in- 
vention, it is preferable that the color processing section 
comprises a color number reducing section for reducing 
to a predetermined number of colors the number of the 
colors in the image data. 

[001 2] According to another aspect of the present in- 
vention, it is preferable that the color processing section 
comprises application means for applying a photosen- 
sitive agent to a real three-dimensional model; and ex- 
posing means for exposing by projecting a predeter- 
mined pattern on the photosensitive agent based on the 
color data. 

[001 3] According to another aspect of the present in- 
vention, it is preferable that the formation section divides 
the three-dimensional shape data of target into a plural- 
ity of layers and forms layer-by-layer. 
[0014] According to another aspect of the present in- 
vention, it is preferable that in the layer-by-layer forma- 
tion, a plurality of sheets are processed based on the 
slice outline of the target. 

[001 5] According to another aspect of the present in- 
vention, it is preferable that each of the formed layers is 
colored layer-by-layer by a color processing section. 
[001 6] According to another aspect of the present in- 
vention, it is preferable that the color processing section 
is an inkjet printer. 

[001 7] According to another aspect of the present in- 
vention, it is preferable that the color processing section 
applies color using a photo-exposure method. 
[001 8] According to another aspect of the present in- 
vention, it is preferable that the formation section com- 
prises a sheet processing section for processing a plu- 
rality of sheets based on the slice outline of the target; 
a sheet layering section for layering the processed 
sheets; and a color processing section for coloring the 
sheets to be processed according to the color of the tar- 
get. 

[0019] According to another aspect of the present in- 
vention, it is preferable that the sheet processing section 
divides the obtained three-dimensional shape data into 
a plurality of sliced layer and processes the sheet cor- 
responding to the sliced layer. 

[0020] According to another aspect of the present in- 
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vention, it is preferable that the color processing section 
adds colors to the processing sliced layer of the sheet 
to be processed, the colors corresponding to the slice 
outline of the divided sliced layers. 
[0021] According to another aspect of the present in- 
vention, it is preferable that the real three dimensional 
model producing apparatus further comprises a shape 
template maintaining section for maintaining a shape 
template and a shape template selecting section for se- 
lecting a suitable shape template based on the obtained 
three-dimensional shape data, wherein a real three-di- 
mensional model is produced by adding formation ma- 
terial to the selected shape template. 
[0022] According to another aspect of the present in- 
vention, it is preferable that the data input section com- 
prises a plurality of cameras, the position of each of 
which is fixed. 

[0023] According to another aspect of the present in- 
vention, it is preferable that the data input section com- 
prises a projector for projecting a predetermined pattern 
on the target. 

[0024] According to another aspect of the present in- 
vention, it is preferable that the modeling section pre- 
pares a plurality of templates of predetermined shape 
for a workpiece which is the processing target, and pro- 
duces a real three-dimensional model using a template 
resembling closest to the obtained three-dimensional 
shape data. 

[0025] According to another aspect of the present in- 
vention, it is preferable that the target captured at the 
data input section is a human being, and the formation 
section separately produces the hair portion and the 
face portion, and forms a real three-dimensional model 
by combining these. 

[0026] According to another aspect of the present in- 
vention, it is preferable that the hair portion and face por- 
tion are colored in advance. 

[0027] According to another aspect of the present in- 
vention, it is preferable that the modeling section obtains 
a three-dimensional shape data with the characteristic 
points exaggerated by extracting the characteristic 
points, and the formation section forms a real three-di- 
mensional model based on the three-dimensional 
shape data with the characteristic points exaggerated. 
[0028] According to another aspect of the present in- 
vention, it is preferable that the formation section pro- 
duces a real three-dimensional model with a thin thick- 
ness by shrinking the scale along the depth axis. 
[0029] According to another aspect of the present in- 
vention, it is preferable that the formation section forms 
a real three-dimensional model by milling. 
[0030] According to another aspect of the present in- 
vention, it is preferable that the formation section cre- 
ates a formation mold and forms a real three-dimension- 
al model using the formation mold. 
[0031] According to another aspect of the present in- 
vention, it is preferable that the formation section is a 
3D lithography device. 



[0032] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 
modeling apparatus further comprises a print text string 
input section for inputting a print text string and a three- 
5 dimensional text information reading section for reading 
three-dimensional text information corresponding to the 
print text string, wherein the formation section marks the 
real three-dimensional model with the three-dimension- 
al text based on the three-dimensional text information. 
10 [0033] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 
modeling apparatus further comprises a print text string 
input section for inputting a print text string, wherein the 
color processing section prints the text string on the real 
15 three-dimensional model based on the text string. 

[0034] According to another aspect of the present in- 
vention, it is preferable that a storing element is embed- 
ded on a real three-dimensional model to be produced. 
[0035] According to another aspect of the present in- 
20 vention , it is preferable that the storing element compris- 
es an input/output section for inputting data from or out- 
putting data to another apparatus. 
[0036] According to another aspect of the present in- 
vention, it is preferable that a display element is mount- 
25 ed on a real three-dimensional model in production. 
[0037] According to another aspect of the present in- 
vention, it is preferable that a communication element 
is mounted on a real three-dimensional model in pro- 
duction. 

30 [0038] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 
modeling apparatus further comprises an accessory 
display section for allowing a user to select an accesso- 
ry. 

35 [0039] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 
modeling apparatus further comprises a three-dimen- 
sional shape data modifying section for modifying the 
inputthree-dimensional shape data based on the select- 
40 ed accessory. 

[0040] According to another aspect of the present in- 
vention, it is preferable that the accessory is a pair of 
eyeglasses. 

[0041] According to another aspect of the present in- 
45 vention, it is preferable that the accessory is a hairstyle 
changing function. 

[0042] According to another aspect of the present in- 
vention, it is preferable that the accessory is a color as- 
signment changing function. 
50 [0043] According to another aspect of the present in- 
vention, it is preferable that the accessory is an orna- 
ment. 

[0044] According to another aspect of the present in- 
vention, it is preferable that the accessory is a shape 
55 proportion changing function for the real three-dimen- 
sional model. 

[0045] In order to achieve the objects described 
above, according to another aspect of the present in- 



25 



30 



35 



40 



45 



50 



3 



5 



EP 1 151 778 A1 



6 



vention, there is provided a real three-dimensional mod- 
el generating method comprising a data input step for 
inputting three-dimensional shape data of a target and 
a formation step for forming a real three-dimensional 
model from the obtained three-dimensional shape data, 
wherein a real three-dimensional model is produced. 
[0046] According to another aspect of the present in- 
vention, there is provided a real three-dimensional mod- 
el producing method comprising a data input step for 
inputting image data by capturing a target from a plural- 
ity of directions; a modeling step for generating three- 
dimensional shape data based on the plurality of ob- 
tained image data; and a formation step for forming a 
real three-dimensional model based on the obtained 
three-dimensional shape data, wherein a real three-di- 
mensional model is produced. 

[0047] According to another aspect of the present in- 
vention, there is provided a real three-dimensional mod- 
el producing method comprising a data input step for 
capturing a target and inputting image data including 
color data; a modeling step for generating three-dimen- 
sional shape data and associated color data; a forma- 
tion step for forming a real three-dimensional model 
based on the obtained three-dimensional shape data; 
and a color processing step for coloring the obtained re- 
al three-dimensional model based on the color data, 
wherein a colored real three-dimensional model is pro- 
duced. 

[0048] According to another aspect of the present in- 
vention, it is preferable that a plurality of image data in- 
cluding the color data are input. 

[0049] According to another aspect of the present in- 
vention, it is preferable that the color processing step 
comprises a color number reducing step for reducing the 
number of the colors in the image data to a predeter- 
mined number of colors. 

[0050] According to another aspect of the present in- 
vention, it is preferable that the color processing step 
comprises an application step for applying a photosen- 
sitive agent to a real three-dimensional model and an 
exposing step for exposing by projecting a predeter- 
mined pattern on the photosensitive agent based on the 
color data. 

[0051] According to another aspect of the present in- 
vention, it is preferable that at the formation step, the 
three-dimensional shape data of target is divided into a 
plurality of layers and a model is formed layer-by-layer. 
[0052] According to another aspect of the present in- 
vention, it is preferable that at the layer-by- layer forma- 
tion, a plurality of sheets are processed based on the 
slice outline of the target. 

[0053] According to another aspect of the present in- 
vention, it is preferable that each of the formed layers is 
colored layer-by- layer, at a color processing step. 
[0054] According to another aspect of the present in- 
vention, it is preferable that at the color processing step, 
color is applied using a photo-exposure method. 
[0055] According to another aspect of the present in- 



vention, it is preferable that the formation step compris- 
es a sheet processing step for processing a plurality of 
sheets based on the slice outline of the target; a sheet 
layering step for layering the processed sheets; and a 
5 color processing step for coloring the sheets to be proc- 
essed according to the color of the target. 
[0056] According to another aspect of the present in- 
vention, it is preferable that atthe sheet processing step, 
the obtained three-dimensional shape data is divided in- 
fo to a plurality of sliced layer and the sheets are processed 
corresponding to the sliced layers. 
[0057] According to another aspect of the present in- 
vention, it is preferable that atthe color processing step, 
colors corresponding to the slice outline of the divided 
15 sliced layer are added on the processing sliced layer of 
the sheet to be processed. 

[0058] According to another aspect of the present in- 
vention, it is preferable that the real three dimensional 
model producing method further comprises a shape 
20 template selecting step for selecting a suitable shape 
template based on the obtained three-dimensional 
shape data, wherein a real three-dimensional model is 
produced by adding formation material to the selected 
shape template. 
25 [0059] According to another aspect of the present in- 
vention, it is preferable that at the modeling step, a plu- 
rality of templates of predetermined shape for a work 
which is the processing target are prepared, and a real 
three-dimensional model is produced using a template 
30 resembling closest to the obtained three-dimensional 
shape data. 

[0060] According to another aspect of the present in- 
vention, it is preferable that the target captured at the 
data input step is a human being, that at the formation 
35 step the hair portion and the face portion are separately 
produced, and that the real three-dimensional model is 
formed by combining these portions. 
[0061] According to another aspect of the present in- 
vention, it is preferable that at the modeling step, a 
40 three-dimensional shape data with the characteristic 
points exaggerated by extracting the characteristic 
points is obtained, and, at the formation step, a real 
three-dimensional model is formed based on the three- 
dimensional shape data with the characteristic points 
45 exaggerated. 

[0062] According to another aspect of the present in- 
vention, it is preferable that, at the formation step, a real 
three-dimensional model with a thin thickness is pro- 
duced by shrinking the scale along the depth axis. 
50 [0063] According to another aspect of the present in- 
vention, it is preferable that at the formation step a real 
three-dimensional model is formed by milling. 
[0064] According to another aspect of the present in- 
vention, it is preferable that at the formation step, a for- 
55 mation mold is created and a real three-dimensional 
model is formed using the formation mold. 
[0065] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 



25 



30 



35 



40 



45 



50 



4 



7 



EP 1 151 778 A1 



8 



model producing method further comprises a print text 
string input step for inputting a print text string and a 
three-dimensional text information reading step for 
reading three-dimensional text information correspond- 
ing to the print text string, wherein, at the formation step, 
the real three-dimensional model is marked with the 
three-dimensional text based on the three-dimensional 
text information. 

[0066] According to another aspect of the present in- 
vention, it is preferable that the real three-dimensional 
model producing method further comprises a print text 
string input step for inputting a print text string, wherein, 
at the color processing step, the text string is printed on 
the real three-dimensional model based on the text 
string. 

[0067] In order to achieve the object described above, 
according to the present invention, there is provided a 
three-dimensional modeling apparatus comprising a 
light projection section for projecting light; a light reflect- 
ing section for reflecting the light incident from the light 
projection section, for projecting a target; a capturing 
section for capturing image of the target where the light 
is projected; and a modeling section for generating 
three-dimensional shape data of the target based on the 
received light data. 

[0068] According to another aspect of the present in- 
vention, there is provided a three-dimensional modeling 
apparatus comprising a data input section for inputting 
image data by capturing a target from a plurality of di- 
rections; a modeling section for generating three-dimen- 
sional shape data based on the plurality of obtained im- 
age data; a light projection section for projecting light 
onto the target; and a light reflecting section for reflect- 
ing the light incident from the light projection section on- 
to the target. 

[0069] According to another aspect of the present in- 
vention, it is preferable that the light projection section 
is a plane light source for projecting a pattern light. 
[0070] According to another aspect of the present in- 
vention, it is preferable that the light projection section 
is a spot light source for irradiating a beam light, and 
that the apparatus further comprises a light reflecting 
section for reflecting the light incident from the light pro- 
jection section and projecting onto the target, in addition 
to a light direction control section for changing the direc- 
tion of the spot light source. 

[0071] According to another aspect of the present in- 
vention, it is preferable that the light projection section 
is a sheet-of-light source, and that the apparatus further 
comprises a light reflecting section for reflecting the light 
incident from the light projection section and projecting 
onto the target, in addition to a light direction control sec- 
tion for changing the direction of the sheet-of-light 
source. 

[0072] According to another aspect of the present in- 
vention, there is provided a three-dimensional modeling 
apparatus comprising a light projection section for pro- 
jecting light onto a target; a target image reflecting sec- 



tion for further reflecting light projected onto the target 
and reflected therefrom; an image capturing section for 
capturing the target image reflected at the target image 
reflecting section; and a modeling section for generating 
5 the three-dimensional shape data of the target based 
on the received light data. 

[0073] According to another aspect of the present in- 
vention, there is provided a three-dimensional modeling 
apparatus comprising a data input section for inputting 
image data by capturing a target from a plurality of di- 
rections; a modeling section for generating three-dimen- 
sional shape data based on the plurality of obtained im- 
age data; and a reflecting section for reflecting the im- 
age of the target, wherein image data of the image re- 
flected at the reflecting section is input at the data input 
section. 

[0074] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating apparatus comprising a data input section for in- 
putting image data by capturing a target from a plurality 
of directions, wherein the data input section comprises 
a parameter setting section for allowing external setting 
of a data input parameter. 

[0075] According to another aspect of the present in- 
vention, there is provided a pseudo-three-dimensional 
data generating apparatus comprising a data input sec- 
tion for inputting image data by capturing a target object 
from a plurality of directions, wherein the data input sec- 
tion comprises a parameter setting section for allowing 
external setting of a data input parameter. 
[0076] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating apparatus comprising a data input section for in- 
putting image data by capturing a target from a plurality 
of directions and a modeling section for generating 
three-dimensional shape data based on the plurality of 
obtained image data, wherein the data input section 
comprises a parameter setting section for allowing ex- 
ternal setting of a data input parameter. 
[0077] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating apparatus comprising data input sections for in- 
putting image data by capturing a target from a plurality 
of directions, wherein a portion of the data input sections 
comprises a data input reference parameter determin- 
ing section for determiningthe reference value for a data 
input parameter and each of the other data input sec- 
tions comprises a parameter setting section capable of 
setting a data input parameter determined at the data 
input reference parameter determining section. 
[0078] According to another aspect of the present in- 
vention, there is provided a pseudo three-dimensional 
data generating apparatus comprising data input sec- 
tions for inputting image data by capturing a target from 
a plurality of directions, wherein a portion of the data 
input sections comprises a data input reference param- 
eter determining section for determining the reference 
value for a data input parameter and each of the other 
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data input sections comprises a parameter setting sec- 
tion capable of setting a data input parameter deter- 
mined at the data input reference parameter determin- 
ing section. 

[0079] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating apparatus comprising a plurality of data input 
sections for inputting image data by capturing a target 
from a plurality of directions and a modeling section for 
generating three-dimensional shape data based on the 
plurality of obtained image data, wherein one or more 
of the data input sections include a data input reference 
parameter determining section for determining a refer- 
ence value for a data input parameter and each of the 
other data input sections includes a parameter setting 
section capable of setting a data input parameter deter- 
mined by the data input reference parameter determin- 
ing section. 

[0080] According to another aspect of the present in- 
vention, it is preferable that in the three-dimensional da- 
ta generating apparatus, the data input section is a cam- 
era and the data input parameter is any of white balance 
parameter or exposure parameter. 
[0081] According to another aspect of the present in- 
vention, it is preferable that in the pseudo three-dimen- 
sional data generating apparatus, the data input section 
is a camera and the data input parameter is any of white 
balance parameter or exposure parameter. 
[0082] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating method. The method comprises a data input 
step for inputting image data by capturing a target from 
a plurality of directions, wherein the data input step com- 
prises a parameter setting step for externally setting a 
data input parameter. 

[0083] According to another aspect of the present in- 
vention, there is provided a pseudo three-dimensional 
data generating method comprising the step of a data 
input step for inputting image data by capturing a target 
object from a plurality of directions, wherein the data in- 
put step comprises a parameter setting step for exter- 
nally setting a data input parameter. 
[0084] According to another aspect of the present in- 
vention, there is provided a three-dimensional data gen- 
erating method comprising a data input step for inputting 
image data by capturing a target from a plurality of di- 
rections, wherein the data input step comprises the 
steps of a data input reference parameter determining 
step for determining the reference parameter when data 
is input and an image input step for inputting an image 
based on the reference parameter. 
[0085] According to another aspect of the present in- 
vention, there is provided a pseudo three-dimensional 
data generating method comprising the step of a data 
input step for inputting image data by capturing a target 
from a plurality of directions, wherein the data input step 
comprises the steps of a data input reference parameter 
determining step for determining the reference param- 



eter when data is input and an image input step for in- 
putting an image based on the reference parameter. 
[0086] According to another aspect of the present in- 
vention, there is provided a three-dimensional datagen- 

5 erating method comprising a data input step for inputting 
image data by capturing a target from a plurality of di- 
rections and a modeling step for generating three-di- 
mensional shape data based on the plurality of obtained 
image data, wherein the data input step further compris- 

10 es a reference parameter determining step for determin- 
ing the reference parameter when data is input and an 
image input step for inputting an image based on the 
reference parameter. 

[0087] According to another aspect of the present in- 
15 vention, it is preferable that in the three-dimensional da- 
ta generating method the data input parameter is white 
balance parameter or exposure parameter. 
[0088] According to another aspect of the present in- 
vention, it is preferable that in the pseudo three-dimen- 
20 sional data generating method the data input parameter 
is white balance parameter or exposure parameter. 

Brief Description of Drawings 

25 [0089] Fig. 1 is a block diagram showing the structure 
of the present invention according to one preferred em- 
bodiment. 

[0090] Fig. 2 is a conceptual diagram showing the 
structure of the present invention according to another 
30 preferred embodiment. 

[0091] Fig. 3 is a diagram showing calibration. 
[0092] Fig. 4 is a diagram showing a structure for pro- 
jecting a random pattern. 

[0093] Fig. 5 is a diagram exemplifying a random pat- 
35 tern. 

[0094] Fig. 6 is a diagram showing usage of a tem- 
plate. 

[0095] Fig. 7 is a diagram showing a structure of a 
forming mold. 

40 [0096] Fig. 8 is a diagram showing another exemplary 
structure of a forming mold. 

[0097] Fig. 9 is a diagram showing yet another exem- 
plary structure of a forming mold. 
[0098] Fig. 10 is a flowchart showing the coloring 

45 process using a resist. 

[0099] Fig. 11 is a flowchart showing the coloring 
process using a photosensitive agent. 
[0100] Fig. 12 is a diagram showing a structure for 
pattern projection. 

50 [0101] Fig. 13 is a diagram showing another exempla- 
ry structure for pattern projection. 
[0102] Fig. 14 is a flowchart for the coloring process 
by removing unnecessary parts. 

[0103] Fig. 15 is a diagram showing the coloring proc- 
55 ess by removing unnecessary parts. 

[0104] Fig. 16 is a diagram showing the coloring proc- 
ess using a heat-shrinkable film. 
[0105] Fig. 17 is a diagram showing coloring process 
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using a stamp. 

[0106] Fig. 1 8 is a diagram showing coloring process 

by three-axes driving an inkjet nozzle. 

[0107] Fig. 19 is a diagram showing an example 

where an inkjet nozzle and a milling head are placed 

together. 

[0108] Fig. 20 is a diagram showing a structure of a 
three-dimensional modeling apparatus according to an- 
other embodiment of the present invention. 
[0109] Fig. 21 (a) and 21 (b) are diagrams for explain- 
ing the positioning of irradiation sources. 
[0110] Fig. 22(a) and 22(b) are diagrams for explain- 
ing a laser ray irradiating device. 
[0111] Fig. 23(a) and 23(b) are diagrams for explain- 
ing the positioning of irradiation sources. 
[0112] Fig. 24 is a diagram showing a structure of a 
three-dimensional data generating apparatus according 
to another embodiment of the present invention. 
[0113] Fig. 25 is a diagram showing the flow of data 
input. 

[0114] Fig. 26 is a diagram showing the estimation 
method for face position. 

[0115] Fig. 27 is a diagram showing the estimation 
method for chin position. 

[0116] Fig. 28 is a diagram showing a simultaneous 
formation method for a plurality of real three-dimension- 
al models. 

[0117] Fig. 29 is a diagram explaining an example 
where simultaneous formation of a plurality of real three- 
dimensional models is difficult. 

[0118] Fig. 30 is a diagram explaining an example 
where simultaneous formation of a plurality of real three- 
dimensional models is possible. 

Best Mode for Carrying Out the Invention 

[01 1 9] Embodiments of the present invention will now 
be described referring to the drawings. 
[0120] Figs. 1 and 2 show a structure of a real three- 
dimensional model generating apparatus according to 
one embodiment of the present invention. 
[0121] A data input section 1 0 captures a target such 
as a person or the face of a person, and produces an 
image data. The data input section 1 0 includes a plural- 
ity of fixed color CCD cameras, as shown in Fig. 2, and 
obtains color image data of the target at a plurality of 
positions. 

[0122] The color image data including the color infor- 
mation obtained by the data input section 1 0 is then in- 
put to a modeling section 12. The modeling section 12 
includes a personal computer or the like, and performs 
three-dimensional modeling based on the plurality of im- 
age data of the target captured from the plurality of po- 
sitions, to obtain three-dimensional shape data of the 
target. 

[0123] The three-dimensional shape data includes 
the color data of the target. For the three-dimensional 
modeling, any method can be used such as, for exam- 



ple, the method disclosed in Japanese Patent Laid- 
Open Publication No. Hei 10-124704. 
[0124] The obtained three-dimensional shape data is 
input to a formation section 14. The formation section 
5 14 is, for example, a milling drill which can move with 
respectto three axes such asxyz, and machines a work- 
piece to produce a real three-dimensional model based 
on the input three-dimensional shape data. 
[0125] The obtained real three-dimensional model is 
10 then supplied to a coloring process section 16. The 
coloring process section is for coloring the real three- 
dimensional model, and, when the target is a person, 
colors at least the eyes and the mouth. 
[0126] As described, in this embodiment, the image 
15 data is obtained by capturing the target using cameras. 
Thus, it is safe even when the target is a human being 
compared to using laser ray. Moreover, color data is ob- 
tained for coloring at the coloring process section. Be- 
cause of this, a real three-dimensional model can be 
20 produced which includes color information, and which 
thus contains unique characteristics. 
[0127] In the following description, the term "three-di- 
mensional shape data" refers to data on the three-di- 
mensional shape information of the target, and may in- 
25 dude the color information. The three-dimensional 
shape data is obtained by inputting an image at the data 
input section and performing a modeling process at the 
modeling section. When the data input section is a 
three-dimensional shape measurement device, the 
30 three-dimensional shape data may be obtained at the 
data input section. Moreover, data which is obtained by 
changing, modifying, integrating, and/or processing the 
obtained three-dimensional shape data is also referred 
to as the three-dimensional shape data. The term "real 
35 three-dimensional model", on the other hand, refers to 
a three-dimensional object produced at the formation 
section based on the obtained three-dimensional shape 
data. The "real three-dimensional model" also includes 
the real three-dimensional model as defined above, 
40 colored at the coloring process section. 

[0128] The term "three-dimensional data" is used in- 
terchangeably with the term "three-dimensional shape 
data" (which may include the color information). A term 
"pseudo three-dimensional data", on the other hand, re- 
45 fersto data which does not contain thethree-dimension- 
al shape information of the target but which can display 
the target in virtual three-dimension. One example for- 
matfor pseudo-three-dimensional data would be Quick- 
Time VR. The term "three-dimensional model" refers to 
50 both the real three-dimensional model and the three-di- 
mensional data as defined above. "Structure of the Data 
Input Section and the Modeling Section" 
[01 29] The data input section 1 0 employs cameras for 
capturing a target. In general, in order to obtain three- 
55 dimensional shape data, a plurality of image data from 
a plurality of directions are necessary for each immov- 
able target. Therefore, it is preferable to fix a plurality of 
cameras at predetermined positions to simultaneously 
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capture the target. However, it is also possible to mov- 
ably mount a camera on a rail and obtain a plurality of 
image data by moving the camera. 
[0130] The absolute positions of the plurality of fixed 
cameras must be precisely determined, but in general 
this may be difficult with the mechanical means. There- 
fore, it is preferable to perform calibration of the camera 
positions by placing a reference object with a predeter- 
mined pattern in the camera view and calibrate the cam- 
era position based on the image data of the reference 
object, as shown in Fig. 3. In this manner, the mounting 
of the cameras itself can be simplified and, at the same 
time, their positions can be precisely detected. It is pref- 
erable to perform the calibration periodically, e.g., on an 
everyday basis, or on an every week basis. 
[0131] In order to precisely obtain three-dimensional 
shape data or the like for a target, each of the sections 
of the target must be seen differently from a plurality of 
directions. Therefore, it is preferable to project a prede- 
termined pattern onto the target using a projector as 
shown in Fig. 4. In this manner, precise three-dimen- 
sional shape data can be obtained, even for sections 
that have uniform colors or where color differences are 
small. 

[0132] This pattern can be removed from the color da- 
ta by data processing or, alternatively, the color data can 
be obtained from the image data without the pattern pro- 
jected. A random pattern as shown in Fig. 5, for exam- 
ple, can be used as the projection pattern. 
[0133] When obtaining three-dimensional shape data 
using such a random pattern, by obtaining depth data 
by a stereo method using a plurality of cameras, a high 
precision modeling is possible even for a recess section. 
[0134] As a camera, it is preferable to use a camera 
with a wide-angle lens. By employing such cameras, a 
plurality of cameras can be installed in relatively small 
spaces. 

[0135] The data input section 10 captures the target 
using the cameras and extracts the target area in the 
image. It is therefore preferable that the background be 
a constant color to facilitate extraction of the target area 
in the image. 

[0136] For example, it is preferable to provide a room 
with the four walls colored in one color and to place the 
target at the center of the room. In particular, when the 
target is a person, it is preferable to place a chair at the 
center of the room and have the person (target) sit on 
the chair. 

[0137] When the target is a person, the image cap- 
tured from the back is usually of less importance. There- 
fore, it is preferable to provide an entrance at one wall 
of the room, have the person sit facing the entrance, and 
to unify thecolor of the walls otherthan the wall with the 
entrance. It is also preferable to omit the image data 
from the back when the target is a person. 
[0138] Furthermore, when the target has a color iden- 
tical to the background color, extraction cannot be per- 
formed correctly. Therefore, it is also preferable to con- 



figure the room so that the background color (the wall 
color of the room) is changeable. For example, by using 
a projector, light of a predetermined color can be pro- 
jected from outside, to thereby set the wall color. 

5 [0139] It is also preferable to use at least two colors 
for the background color, obtain image data with two 
types of background colors, and extract the target area 
in the image by the union of the extracted results at the 
two background colors. In this manner, the extraction of 

10 the target area in the image can be precisely done for 
targets of any color. 

[0140] It is also preferable to provide lighting appara- 
tuses at the corners of the room for uniform lighting ef- 
fect on the target and light up the room so that there will 
15 be no shadows on the target. 

[0141] In the above, an example is shown where the 
projection pattern is a random pattern. However, it is al- 
so possibleto use various other patterns such as a black 
and white stripe pattern, a color stripe pattern, etc. It is 
20 also possible to employ for inputting the three-dimen- 
sional shape data a three-dimensional shape measur- 
ing device using a triangulation method with a laser ray. 
[0142] It may in some cases be preferable that the 
three-dimensional shape data input as described above 
25 be modified through a modification process. For exam- 
ple, there may be cases where input failure occurs for 
a portion of the three-dimensional shape data such as 
the hair portion. Moreover, even when the input is suc- 
cessful, there are cases where, when forming the actual 
30 model, the removal of unnecessary portions is desira- 
ble. Specifically, when a human face is input, the three- 
dimensional shape data is usually generated with a por- 
tion of the shoulder. In such a case, it is preferable to 
remove the unnecessary portions of the shoulder and 
35 to form the portion above the neck at the formation sec- 
tion. 

[0143] In orderto solve the above problem, the follow- 
ing processes are performed at the three-dimensional 
shape data modifying section. 

40 

1 . When input for three-dimensional shape data fails 

[0144] When input for three-dimensional shape data 
fails, three-dimensional shape data can be generated 
45 by detecting the void (missing) portion in the three-di- 
mensional shape data and performing, for example, a 
linear interpolation process using the three-dimensional 
shape data near the missing portion. Alternatively, it is 
possible to pre-provide a plurality of templates with no 
50 data missing and to select a template that resembles 
closest to the three-dimensional shape data with miss- 
ing portion. 

[0145] Then, the missing portion of the three-dimen- 
sional shape data is replaced by the selected template 
55 data. In this case, there is a possibility that a disconti- 
nuity will be created at the boundary between the portion 
that has been replaced and the portion that has not. In 
orderto avoid such a discontinuity, it is preferableto per- 
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form smoothing process on the three-dimensional 
shape data. 

2. When an unnecessary portion of the three- 
dimensional shape data is to be removed 

[0146] When an unnecessary portion of the three-di- 
mensional shape data is to be removed, preformed face 
templates can be provided. The face template can be 
simple, such as an egg-shaped template, or can be a 
gradation pattern having an egg-shaped expansion 
based on a Gaussian distribution. The obtained three- 
dimensional shape data is projected onto a two-dimen- 
sional screen from a point of view at the front side and 
matching process is performed on the two-dimensional 
screen. 

[0147] When an optimal match is found, the neck por- 
tion is estimated, and portions below the neck portion 
can be removed. An example of inputthree-dimensional 
shape data, face template, and optimal matching is 
shown in Fig. 26. 

[0148] When a more precise removal process is to be 
performed, it is preferable to re-examine the three-di- 
mensional shape data from the neck portion estimated 
as above (neck A) to identify the chin position, re-esti- 
mate the neck portion, and remove the portion below 
the re-estimated neck portion. The identification of chin 
position is relatively simple. 

[01 49] Specifically, the center sliced layer of the three- 
dimensional shape data in the right and left direction is 
calculated, and cross sectional data of the three-dimen- 
sional shape data at this sliced layer is obtained. Then, 
the chin portion can be identified by extracting a portion 
where the positive curvature is great, which is a charac- 
teristic of the chin, around the estimated neck A. An ex- 
ample of such a process is shown in Fig. 27. 
[0150] In addition, it is also preferable that the input 
section includes an interface for setting a mask, so that 
a user can indicate the removal sections usingthe mask. 
The interface shows at least one of the input images and 
a template for masks, and the user can suitably set the 
mask by changing the size, shape, and position of the 
mask using a mouse or a joystick. 

"Structure of the Formation Section" 

[0151] The formation section 14 produces a real 
three-dimensional model based on the three-dimen- 
sional shape data. As the formation section 1 4, a milling 
drill capable of three-dimensional processing can be 
used, as described earlier. When the target is a human 
face, a process with only one drill axis direction is also 
possible. However, in order to precisely process fea- 
tures such as nostrils or the like, it is preferable to use 
a processing device which can also perform rotation of 
the drill axis direction. 

[0152] The material to be used as the basis for the 
real three-dimensional model includes a scantling and 



a round bar. However, when the target is known to some 
extent, for example, when the target is a human face, it 
is preferable to prepare a template (a prototype of the 
work to be processed) which resembles the shape of 
5 the target and process the template. In this manner, the 
time required for processing can be reduced. 
[0153] Moreover, various types of templates can be 
prepared, as shown in Fig. 6, and a template closely re- 
sembling the obtained three-dimensional shape data 
10 can be selected for processing. 

[0154] In the example shown in Fig. 6, a template for 
a round face and a template for thin face are separately 
prepared, and a suitable template for processing can be 
selected according to the shape of the target face. In 
15 this manner, processing can be facilitated and the 
processing time can be further reduced. Moreover, by 
using such a template, the amount of waste generated 
during milling can also be reduced. 
[0155] Furthermore, it is also possible to modify the 
20 obtained three-dimensional shape data by morphing so 
that the data more closely resembles the shape of the 
selected template and to process the template, resulting 
in further reduction in the processing time. 
[0156] For the area corresponding to the target's hair. 
25 it is possible to use a pre-provided template without 
processing. In other words, hair is not usually as impor- 
tant, and it is likely that a template chosen from among 
few types of pre-provided templates will provide a suffi- 
cient match. Therefore, by preparing few types of tem- 
30 plates for the hair portion, it is possible to select and use 
one template from among the prepared templates. It is 
also possible to separately prepare the templates for the 
hair portion and the templates for the face portion. 
[0157] In this case, the hair portion can be colored in 
35 black. In this manner, coloring process for the hair por- 
tion can be omitted. Even when the coloring process 
must be performed, by separately coloring the hair por- 
tion, the overall coloring procedure can be simplified. 
[0158] It is preferable that the hair portion is formed 
40 so that it is applied to the face portion by covering on 
the upper section of the face, similar to a wig. It is also 
possible to form the hair portion as a wig with a thread 
as the hair. 

[0159] It is also possible to generate a forming mold 
45 and produce a real three-dimensional model using the 
mold. Fig. 7 shows a forming mold using a flexible film 
30 and a pin assembly 32. The pin assembly 32 is con- 
structed from a plurality of pins 34, each of which is mov- 
able and fixable. As shown in the figure, by determining 
50 the positions of one or more of pins 36 by an actuator 
and applying the pin(s) 36 via the flexible film 30, the 
positions for each of the pins 34 of the pin assembly 32 
can be set. Once the shape of the pin assembly 32 is 
determined, the shape of the flexible film 30 which cov- 
55 ers the pin assembly is also determined. 

[0160] It is possible to create a forming mold by con- 
structing an object with the pin assembly 32 having the 
positions of pins 34 fixed and the flexible film 30, and 
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generate a real three-dimensional model by filling a ma- 
terial into the forming mold and solidifying the material. 
By forming a mold in this manner, a plurality of real three- 
dimensional model can be easily produced. 
[0161] For example, by using a heat resistant film as 
the flexible film 30, a thermosetting resin can be used 
as the material for formation by heating. 
[0162] By applying a reset plate 38 from the opposite 
side of the pin assembly 32, the pins 34 of the pin as- 
sembly 32 pushed by the pins 36 can be restored to their 
original positions and be ready for the next formation. 
When the shape of the target is known to some extent, 
such as when the target is a human face, it is also pref- 
erable to set the shape of the reset plate 38 into a shape 
corresponding to a general shape corresponding to the 
target in order to set the default shape of the pin assem- 
bly 32 close to the final shape of the target. 
[0163] The pins 34 of the pin assembly 32 need not 
face the same direction. It is also possible to set an axial 
direction for each pin and place the pins according to 
the set directions, in order to support a curved shape. 
[0164] In the example shown in Fig. 7, the pins are 
passively moved. However, it is also possible to provide 
a plurality of actuators 40, each of which corresponds 
to a pin 34, and control the shape of the pin assembly 
32 by driving the plurality of the actuators 40. In this 
case, it is also preferable to provide a flexible film 30 on 
top of the pins 34. 

[0165] Fig. 9 shows a case where each of the pins 34 
are provided in a shape corresponding to a sphere. By 
arranging the pins 34 in this manner, each pin 34 ex- 
tends radially outward and actuators 40 are placed ther- 
eon. By doing so, the space for placing each actuator 
40 can be broadened and, at the same time, the density 
of the head of the pins 34 can be increased. 
[0166] The above configuration is also preferable be- 
cause a human face resembles a sphere. However, the 
shape of the group of heads of the pins 34 need not be 
shaped into a perfect sphere, and can be any suitable 
arrangement according to the shape of the target. 
[0167] In this arrangement, it is also possible to indi- 
vidually determine the positions of the heads of the pins 
34 by individually driving actuators 40, in order to shape 
the flexible film 30 supported by the pins 34 into a de- 
sired shape. Thus, formation of a real three-dimensional 
model with a desired shape can be achieved. 
[0168] When forming, rather than using the three-di- 
mensional shape data as it is, it is also possible to shrink 
the scale of the three-dimensional shape data along the 
depth axis and form a real three-dimensional model 
based on the compressed data. A relief-type real three- 
dimensional model can be formed in this manner. The 
relief-type real three-dimensional model is easier to 
form, andthe milling waste dueto usage of an engraving 
machine can be reduced. 

[0169] It is also preferable to extract a characteristic 
portion of the target and to form a model accordingly. 
For example, by applying an edge exaggerating process 



on the three-dimensional shape data, the characteristic 
portion of the three-dimensional shape data can be ex- 
aggerated. By producing a real three-dimensional mod- 
el with the characteristic portion exaggerated, a real 

5 three-dimensional model which accurately captures the 
characteristics of the target can be obtained. 
[0170] It is also possible to produce the forming mold 
using clay or the like. In this case, the clay or the like 
can be recycled. 

10 [0171] Formation method has been described. In any 
of the described formations, it is preferable to generate 
a plurality of real three-dimensional models in one for- 
mation process by integrating a plurality of input three- 
dimensional shape data. For example, for creation by 

15 milling, the material can be efficiently used. Moreover, 
for creation by light as described below, the overall 
processing time can be shortened when a plurality of 
models are created at once, compared to a case where 
the models are individually produced. 

20 [0172] When a plurality of three-dimensional shape 
data are gathered, it is necessary to convert the coordi- 
nates in each of the three-dimensional shape data in 
consideration of the formation region. In an example 
where four input face data are used for simultaneous 

25 formation, each data item is a three-dimensional shape 
data with its own coordinate system. Therefore, it is nec- 
essary, as shown in Fig. 28, to translate these to repo- 
sition the data in the formation region. 
[0173] In such a case, there are cases where the 

30 translation operation alone is not sufficient to fit the data 
in the formation region. For example, as shown in Fig. 
29, when one of the four face data to be simultaneously 
generated contains a face with significantly larger 
number of hair, if the data are placed evenly, an over- 

35 lapped section will be generated, which will impede for- 
mation of a quality model. In this case, it is first deter- 
mined whether these data to be simultaneously formed 
can be placed in the formation region without overlap- 
ping. When an overlapped section is generated, the 

40 three-dimensional shape data in which an overlap exists 
is extracted and rotated, and possibility for placing in the 
formation region is reexamined. This process is repeat- 
ed until overlap is no longer produced, or for a constant 
number of times. When no result can be obtained after 

45 the constant number of examination for no overlap, one 
of thethree-dimensional shape data in which an overlap 
occurred is removed, and the examination process as 
described above is repeated. An example of placement 
without overlap after this process is shown in Fig. 30. 

50 [0174] In some cases, it is desirable to form the model 
with the overlap between the plurality of three-dimen- 
sional shape data. In that case, the object of the inte- 
grated production of the plurality of data is to increase 
the added value of the real three-dimensional model to 

55 be produced, rather than effective usage of the material 
or increasing the processing speed. 
[0175] For example, consider a case for producing a 
real three-dimensional model based on a group picture. 
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In other words, consider a case where a real three-di- 
mensional model is formed with only a few people. It is 
difficult to input the three-dimensional shape data with 
a plurality of people gathered because a larger region 
must be three-dimensionally input compared to a case 5 
for a single person. Therefore, there tends to be prob- 
lems such as an increase in the price of the input device 
or decrease in the input precision. 
[0176] It is thus preferable to individually input the 
three-dimensional shape data and to integrate the 10 
three-dimensional shape data to resemble a group pic- 
ture when forming the model. The integration can be 
done by actually capturing a two-dimensional group im- 
age and placing three-dimensional shape data based 
on the two-dimensional image. More specifically, the re- 15 
al three-dimensional model generating apparatus has 
an user interface, which enables display of a two-dimen- 
sional group picture, display of the three-dimensional 
shape data to beformed, and placement of these shape 
data using a mouse or a joystick. The user can, for ex- 20 
ample, move the three-dimensional shape data using a 
mouse or the like onto the image of each individual in a 
group picture, while looking at the displayed two-dimen- 
sional group picture, so that the three-dimensional 
shape data overlap. The three-dimensional shape data 25 
can be displayed from a point of view different from that 
of the two-dimensional group picture. It is also possible 
to specify on the positions of the three-dimensional 
shape data in the depth direction. 

[0177] In this manner, a suitable integration of the 30 
three-dimensional shape data according to the two-di- 
mensional group picture is enabled. Use of this system 
along with a system which can automatically judge the 
face enables process automation. 

35 

"Structure of Coloring Process Section" 

[0178] The coloring process section 1 6 applies color- 
ing process on the real three-dimensional model ac- 
cording to the color data. Various methods exist for the 40 
coloring process, and example methods will be de- 
scribed below. 

[0179] First, a resist can be applied on the real three- 
dimensional model and coloring process can be per- 
formed using the resist. This method will now be de- 45 
scribed referring to Fig. 10. A resist is applied on the 
surface of the real three-dimensional model (step S1 1 ). 
When the target is a human face, it is only required to 
color the face, and thus, in such a case, the face portion 
is the only target for the coloring process. 50 
[0180] Then, using a predetermined pattern, by ex- 
posing the necessary portion or thinly milling with a drill 
or the like, the resist on the portion is partially removed 
(step S1 2). The partial removal is performed forthe por- 
tion to be colored for each color. Coloring process for 55 
one color is then performed on the removed portion 
(stepS 13). 

[0181] It is then judged whether coloring process for 



all the colors are completed (step S14). If not, the pro- 
cedure jumps back to step S11 and performs coloring 
process forthe next color. Here, by using a material that 
repels the paint which is used for coloring, selective 
coloring on the portion where the resist is removed is 
possible. Becausethe resist is fairly thin, no problem will 
be created when a portion of the resist is left on the mod- 
el. It is preferable to cover the entire model with a dura- 
ble protection film or the like after all the coloring proc- 
esses are completed. With this method, it is better to 
minimize the number of colors. Accordingly, when the 
target is a human face, it is preferable to simplify the 
process to some extent by, for example, coloring the 
eyes with a black color and lips with a red color. 
[0182] When the above described coloring method is 
employed, there will be a limit to the number of colors 
for coloring the target. Therefore, there is a need for a 
reducing process to reduce the number of colors in the 
original color data included in the obtained image data. 
Preferable reduction can be accomplished by, for exam- 
ple, a process with the following steps. 

1 . Divide the obtained image data into regions 

2. Obtain the average color value within one region 

3. For each region, compare the average color val- 
ue with all the prepared available colors, to obtain 
the available color closest to the average color val- 
ue 

4. Replace the color within the region by the avail- 
able color determined at step 3 

[0183] It is also preferable to use a photosensitive 
agent for the coloring process. This method will be de- 
scribed with reference to Fig. 11. First, a photosensitive 
agent is applied on the real three-dimensional model 
(step S21). Then, a pattern is projected based on the 
color data to expose the photosensitive agent (step 
S22). 

[0184] A fixing process is applied to the photosensi- 
tive agent to fix the color (step S23). The pattern projec- 
tion can be achieved, as shown in Fig. 12, by irradiating 
light from a light source onto a real three-dimensional 
model (three-dimensional object), with the photosensi- 
tive agent applied, via an projection pattern. The projec- 
tion pattern can be, for example, a transmission type liq- 
uid crystal panel. 

[0185] It is also possible to directly project a pattern 
onto the real three-dimensional model using a CRT. In 
this example, the three-dimensional model is aface, and 
thus, the exposure is performed by one projection from 
the front side. In particular, by using a long focal length 
lens to ensure a sufficient focus depth even for a three- 
dimensional object, exposure of the entire face portion 
(hemisphere) can be performed using one projection 
pattern. 

[0186] When the depth direction is compressed for a 
relief-type real three-dimensional model, the likelihood 
of obtaining a uniform exposure is increased. As a pho- 
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tosensitive agent, silver halides such as silver bromide, 
silver chloride, or silver iodide can be used. These pho- 
tosensitive agents are applied on the surface of the real 
three-dimensional model, dried, and then exposed. 
[0187] Because the real three-dimensional model is 
a three-dimensional object, there are many cases where 
sufficiently uniform exposure cannot be achieved due to 
the direction of the surface. In light of this possibility, as 
shown in Fig. 13, it is preferable to provide a plurality of 
projection patterns corresponding to the directions of 
surfaces of the real three-dimensional model and to ex- 
pose the photosensitive agent from a plurality of direc- 
tions. 

[0188] In such a case, it is preferable to apply masks 
to limit the amount of light incident on an overlapped 
section from the plurality of projection patterns. In this 
case, it is preferable to fix the positions of the light 
source and the projection patterns, and vary the mask- 
ing based on the real three-dimensional model. 
[0189] Moreover, it is preferable to remove unneces- 
sary portions after completing the overall coloring proc- 
esses. In other words, as shown in Fig. 14, the real 
three-dimensional model is colored (step S31). and then 
the unnecessary portions are removed by a drill or the 
like (step S32). In this manner, coloring process for only 
the necessary portion can be achieved. For example, 
as shown in Fig. 15, in a human head, the material for 
the portion above the mouth can have a black color and 
the material for the portion below the mouth can have a 
red color. A skin colored paint is then applied to the en- 
tire head. By milling and removing the paints on the eye, 
hair and mouth sections, black eyes, black hair, and red 
lips can be formed. 

[0190] As shown in Fig. 1 6, it is also preferable to print 
a pattern on a heat-shrinkable film and to affix the film 
on the real three-dimensional model. In this case, a 
shrinking ratio must be calculated from the shape before 
printing, and thinning the color for a portion with high 
shrinking ratio is also required. Accurate color after 
shrinkage can thus be obtained. While color division 
may occur when film is expanded, shrinkage does not 
produce such a problem, and, therefore, thicker coloring 
can be obtained. 

[0191] As the heat-shrinkable film, it is preferable to 
apply a thin coat of a water soluble polymer such as PVA 
(polyvinyl alcohol) on a film of polyvinyl chloride or flu- 
oride resin, to have a printing capability (print). It is also 
possible to use an expandable cloth in place of the film. 
[0192] It is also possibleto employ thefollowing color- 
ing scheme. 

[0193] For a human face, the main characteristics are 
the eyes and mouth. Thus, it is preferable to only color 
the eyes and mouth. In many cases, the positions of 
these items, rather than the shape, is the characteristic 
feature. Thus, as shown in Fig. 17, it is preferable to 
provide two stamps for eyes and one stamp for the 
mouth and color the real three-dimensional model by 
pressing these stamps against the surface. In this case, 



the stamps for the eyes are movable in the horizontal 
direction of the face and the stamp for the mouth is mov- 
able in the vertical direction of the face, allowing for ad- 
justment of the stamp positions. By forming the stamps 

5 by a material which can be deformed, such as, for ex- 
ample, a sponge-like material, the surface can easily be 
colored even when the surface is not completely flat. A 
sponge-like material is also preferable because it can 
readily hold the coloring agent in the material. 

10 [0194] It is also preferable to prepare a plurality of 
shapes for the eyes and mouth, select the shape resem- 
bling closest to the target, and colorthe selected shape. 
It is also possible to drive a plurality of brushes for each 
color based on the data for the coloring process. 

15 [0195] As shown in Fig. 18, it is also preferableto drive 
an inkjet nozzle with three axes (rotation of the real 
three-dimensional model, and movement of the nozzle 
in the y and z directions). In this manner, a predeter- 
mined color can be applied to a predetermined location. 

20 As shown in Fig. 19, it is also possibleto provide both 
an inkjet nozzle and a milling head with a forming drill 
on single component. By employing such a scheme, for- 
mation and coloring processes can be performed almost 
simultaneously, and there is a further advantage that on- 

25 |y one control mechanism is required. In a case where 
coloring process is performed after formation, the com- 
ponents can be driven based on the identical data for 
identical movement, and thus, the coloring process can 
be efficiently performed. 

30 [0196] It is also possibleto colorthe real three-dimen- 
sional model by an impact dot method using a wire dot 
and an ink ribbon. 

[0197] Moreover, it is also preferable, during the color- 
ing procedure, to use a contact pin sensor to detect the 

35 surface position of the real three-dimensional model and 
to color based on the detected position. In this manner, 
a precise coloring process can be performed even when 
the formation precision is insufficient. 
[01 98] It is also possibleto transfer using a color proc- 

40 essed film. 

[0199] It is also preferable to layer and bond a plurality 
of pieces of paper based on the obtained three-dimen- 
sional shape data to form a three-dimensional object. In 
such a method, the target shape is first divided at a plu- 

45 rality of parallel planes corresponding to each of the plu- 
rality of pieces of paper to be layered and bonded. For 
example, such a plane can be a plane perpendicular to 
the y axis (vertical axis) assigned to the three-dimen- 
sional shape data. 

50 [0200] After printing the color on the cross section be- 
tween each plane and the target shape on each piece 
of paper, the cross sections of these pieces of paper are 
cut, and the pieces are overlapped. In this manner, 
colored three-dimensional object can be formed. 

55 [0201] It is also possible to use a 3D lithography de- 
vice as the formation section. In this case, similar to the 
formation by paper as described above, the target 
shape is first represented by a plurality of layers, and 
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then, the model is formed layer-by-layer. I nth is process, 
after one layer is formed, color is applied to each layer 
surface, allowing for formation of colored real three-di- 
mensional model. Various methods can be used for 
coloring, including use of an inkjet printer or photosen- 
sitive agent, both described earlier. 
[0202] In order to quickly perform the 3D lithography 
process, it is preferable to form the model by preparing 
a template and filling the periphery. In this case, a plu- 
rality of templates can be prepared. A template with a 
maximum size is selected from among templates which 
can befit within the input three-dimensional shape data. 
[0203] The template formed in this manner is then 
dipped in a solution of photo-curing resin at the 3D li- 
thography device and light is irradiated only to the area 
where filling is required. In a 3D lithography device 
which employs a laser beam for light irradiation, scan- 
ning manipulation for irradiating the laser beam on the 
entire region of curing target is necessary. By using the 
templates, the size of the scan region can be reduced, 
and thus, the overall formation time will be shortened. 

"Variations" 

[0204] It is also preferable to display the three-dimen- 
sional shape, including the color, on a display when the 
three-dimensional shape data is obtained, in orderto al- 
low a preview of the real three-dimensional model to be 
produced. When any number of processes described 
above are applied to compress, exaggerate the charac- 
teristic points, and/or limit the colors, it is preferable to 
show a display which is as close to the final product real 
three-dimensional model as possible. 
[0205] It is also preferable to prepare various options 
and accessories that are different from the actual target, 
such as, for example, glasses and hair styles, and to 
permit mounting these optional items on the real three- 
dimensional model. 

[0206] The final real three-dimensional model of a 
person can be either the head portion only or the com- 
plete person. For example, when a complete model is 
desired, because the face becomes relatively small, it 
is preferable to form the model by emphasizing the face 
by setting the face to body ratio to 1:1. It is also prefer- 
able to prepare few such variations, so that a customer 
can select one from among the prepared variations. 
[0207] When the target is a pet such as a dog, it may 
be necessary to restrain the pet during capturing. There- 
fore, it may be preferable to provide a chain at the cap- 
turing locations. Extraction of the target from the cap- 
tured image data can be facilitated by using the same 
color for the chain as for the background color. 
[0208] When mass producing and delivering a great 
quantity of real three-dimensional models, it may be de- 
sirable to assign an identification number to each of the 
real three-dimensional models in orderto identify each 
real three-dimensional model and recognize the rela- 
tionship to the delivery destination. 



[0209] It may further be preferable to record the iden- 
tification number on the real three-dimensional model 
when forming or color processing the real three-dimen- 
sional model. In other words, an identification number 
5 for each of the three-dimensional shape data is input by 
a user or automatically assigned when inputting the in- 
itial data. Three-dimensional text data corresponding to 
the identification number can be assigned to obtained 
three-dimensional shape data, on a surface (for exam- 
10 pie, the bottom surface) of the three-dimensional shape 
data, to produce a recess that can be identified as a text. 
By performing the formation process based on the data, 
a real three-dimensional model with the identification 
number engraved on the surface can be produced, 
15 which facilitates later identification of each of the real 
three-dimensional models. It is also possible to print the 
identification number on the surface of the real three- 
dimensional model by a printer or the like during the 
coloring process. 
20 [021 0] Moreover, it is preferable to perform the forma- 
tion process considering a mounting portion for mount- 
ing a storage element, display element, communication 
element, etc. on the real three-dimensional model to be 
formed. By mounting a storage element such as a com- 
25 pact flash memory, display element such as a compact 
LCD panel, or by mounting a compact transmitter/ re- 
ceiver on the real three-dimensional model thus formed, 
it is possible to enable the following operations and thus 
to increase the pleasure of the three-dimensional mod- 
30 el. 

1 . By recording a voice message, the voice mas- 
sage can be generated from the real three-dimen- 
sional model. 

35 2. By displaying the condition of the real three-di- 
mensional model on the display element, the real 
three-dimensional model can be treated as a game 
pet. 

3. The three-dimensional models can communicate 
40 with each other or with other game machines or a 
personal computer. 

[0211] In addition, when the input three-dimensional 
shape data is data including a portion of the human body 
45 in addition to the face or when the data is the overall 
body data, it is preferable to form the real three-dimen- 
sional model to be movable at the joint sections similar 
to the actual human body which is movable at the joints. 
[0212] For this purpose, the input three-dimensional 
50 shape data can be divided into a plurality of portions with 
the movable section as the dividing point. This division 
can be done either manually by a user interface or by 
providing templates for a human skeleton, and specify- 
ing the dividing points by matching the skeleton tem- 
55 plate with the input three-dimensional shape data. Fur- 
thermore, it is also possible to input a plurality of poses, 
apply three-dimensional matching process to each sec- 
tion, and specify the dividing points by automatically ex- 
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tracting the joints. 

[0213] The three-dimensional shape data thus divid- 
ed is then modified in order to embed a connecting tool 
in the joints. Because the connecting tools are pre-pro- 
vided for each joint, and the shapes are known, it is pos- 
sible to automate this procedure. 
[021 4] After the modification process, each of the por- 
tions are formed. A final real three-dimensional model 
is produced by fitting the separately prepared connect- 
ing tools in each of the formed portion and linking each 
of the formed portions. 

[0215] It is preferable that a driving function such as 
a micromotor is provided on the connecting tools. When 
such a motor is provided, a movement input section for 
the three-dimensional shape data is further provided. 
The three-dimensional information on the movement of 
the human target is obtained from the movement input 
section, and, by moving each of the portions through 
controlling the driving device based on the movement 
obtained from the information, it is possible to produce 
a miniature real three-dimensional model based on the 
movement characteristic which is unique to the target 
person. This enables, for example, display of a minia- 
ture model in a funeral or the like that reproduces the 
unique actions of the deceased. In addition, it is possible 
to realize a mascot doll with the actions of a celebrity. 
[021 6] It is also preferable to generate and display an 
image, preferably a three-dimensional image reproduc- 
ing these actions based on the three-dimensional infor- 
mation, instead of actually forming the real three-dimen- 
sional model. 

[0217] It is preferable to integrate the present inven- 
tion as a single apparatus and place the integrated ap- 
paratus in an arcade or an amusement center. In this 
manner, a user can enter the apparatus and create im- 
age data in the same fashion as taking a photograph. 
After waiting for a brief period of time, the user can ob- 
tain a real three-dimensional model doll at the takeout 
pocket section. A doll of the user can be produced in a 
similar manner as a picture or a sticker. It is also pref- 
erable, when the time before completion of the produc- 
tion is considered to be significant, that a card which the 
user may later exchange for the finished doll be issued. 
In such a case, the doll for a user can be automatically 
discharged to the takeout section by reading the issued 
card by a card reader. 

[0218] Fig. 20 is a diagram showing a structure of a 
three-dimensional model generating apparatus accord- 
ing to another embodiment of the present invention. 
[0219] A light projection section 200 projects a ran- 
dom pattern, slit pattern, or coding pattern assigned on 
a panel 201 onto a target which is, in this case, a human 
face. The projected pattern light pattern is reflected at a 
reflecting section 202 and projected onto the target 203. 
[0220] An image of the target on which the light pat- 
tern is projected is then captured by an image input sec- 
tion 204 such as a CCD camera, and three-dimensional 
data of the target is produced at a modeling section 205 



from the plurality of obtained images by any of the above 
described methods. 

[0221 ] When the distance between the light source of 
the light projection section 200 and the target is small 
5 and the pattern is directly projected on the target, the 
target itself produces a shadow, resulting in some por- 
tion of the target not projected with the pattern. In other 
words, there will be portions which cannot be seen from 
the light source (dead angle). In a case shown in Fig. 
21(a), no pattern is projected onto a part of the neck, 
due to a shadow from the chin. 

[0222] Thus, the shape measurement of these por- 
tions will be difficult or inaccurate. 
[0223] One solution for preventing such possibility of 
a dead angle is to set the distance between the light 
source and the target sufficiently large, as shown in Fig. 
21 (b). However, such a solution causes the size of the 
overall apparatus to become very large. 
[0224] Thus, a reflecting section 202 is provided to re- 
flect the projection pattern and project onto the target. 
[0225] By employing such a method, the light path dis- 
tance from the light projection section 200 to the target 
can be set at a large distance while keeping the size of 
the overall apparatus from becoming large. 
[0226] It is also possible that the light irradiating sec- 
tion 200 irradiate a laser ray, rather than the light pattern 
as described above. Atypical laser ray irradiating device 
may have a structure such as that illustrated in Fig. 22. 
[0227] In Fig. 22(a), the direction of a beam-type laser 
ray is changed by a galvano mirror or a polygon mirror, 
in order to allow a two-dimensional scan. 
[0228] In Fig. 22(b), a beam-type laser ray is once 
changed into a slit light at a cylindrical lens and then the 
direction of the laser ray is changed by a galvano mirror 
or a polygon mirror, in order to allow a two-dimensional 
scan. 

[0229] However, even with these configurations, 
when the distance to the target is insufficient, there will 
be problems associated with the produced dead angle. 
Therefore, setting the light path distance large using a 
reflecting section is again an effective method for reduc- 
ing the dead angle. 

[0230] The problem of dead angle is similarly gener- 
ated when the object with the projected pattern is input. 
For example, as shown in Fig. 23(a), when an image is 
to be taken using a CCD camera for an object with the 
projected pattern, the neck portion which is covered by 
a shadow of the chin cannot be input due to the reason 
described above. In such a case, as shown in Fig. 23 
(b), one solution is to set the distance between the cam- 
era and the target sufficiently large, using a lens with a 
longer focal distance. However, similar to the above, 
there remains the problem that the overall size of the 
apparatus becomes very large. 

[0231] Thus, a camera captures an image of an image 
of the pattern projected target reflected at the reflecting 
section. With this configuration, the distance from the 
target to the camera can be set at a large distance while, 
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at the same time, the size of the overall apparatus can 
be kept small, resulting in reduced dead angles. 
[0232] Fig. 24 is a diagram showing a structure of a 
three-dimensional data generating apparatus according 
to another embodiment of the present invention. 
[0233] Provided are a plurality of data input section 
240 for capturing a target from a plurality of directions 
and inputting the image data. Each data input section 
240 further includes an image input section 241 . As the 
image input section 241 , an analog or digital color CCD 
camera or the like can be used. 
[0234] One or more of the data input sections have a 
data input reference parameter determining section 242 
for suitably determining the parameters during the data 
input, such as white balance and exposure. 
[0235] The remaining data input sections, on the other 
hand, have a parameter setting section 243 for setting 
the parameters to those determined at the data input 
reference parameter determining section 242. At these 
data input sections, image input is performed based on 
the set parameters. 

[0236] At the modeling section 244, three-dimension- 
al shape data of the target is calculated based on the 
plurality of images obtained at the data input sections. 
An example of such a modeling process includes, for 
example, the method disclosed in Japanese Patent 
Laid-Open Publication No. Hei 10-124704. 
[0237] The flow of data input will now be described 
referring to Fig. 25. 

[0238] Parameters such as white balance and expo- 
sure are automatically determined at a data input sec- 
tion (step S1 0). This can be easily accomplished by au- 
tomatic white balance and/or automatic exposure func- 
tions provided on a common camera. 
[0239] The determined parameters are then notified 
to the other data input sections (step S 11 ). 
[0240] At each of the data input sections, the notified 
parameters are set at the parameter setting section 
within each ofthe data input sections (stepS12). In other 
words, at these data input sections, the parameters are 
not automatically determined at the respective input 
sections, but rather, the parameters notified from out- 
side are set. 

[0241] An image is then input at all of the data input 
sections based on the set parameters (step S13). 
[0242] In this manner, by using the parameters deter- 
mined at one data input section as common parameters, 
and inputting the image at all the data input sections 
based on the common parameters, image input with uni- 
form quality can be obtained. 

[0243] If, on the other hand, the parameters are indi- 
vidually set at each of the data input section to suit the 
individual views, different parameters will be set as the 
suitable parameters because (a) the portion of the target 
which can be seen from the input sections will be differ- 
ent and (b) the background (portion other than the tar- 
get) which can be seen from the input sections will be 
different. Therefore, although the color for one element 



should be identical, it differs for each of the data input 
sections, causing a problem when one unified three-di- 
mensional shape data is generated. 
[0244] However, by determining a reference parame- 
5 ter and using the reference parameter as a common pa- 
rameter, image input is enabled which satisfies the con- 
dition thatthe colorforthesame elementshould be iden- 
tical. 

[0245] Here, an example is described wherein the ref- 
10 erence parameter is automatically determined at one 
data input section, but the reference parameter can also 
be determined by an operator. There are some cases 
where an experienced operator wishes to set a suitable 
parameter value different from the value automatically 
15 determined by the data input section, based on his ex- 
perience or when he wishes to have a special effect. In 
such a case, it is preferable to manually set the refer- 
ence parameters. 

[0246] In the above example, a case is shown where 
20 three-dimensional shape data of the target is created. 
However, the method can also be applied to a case 
where it is desired to create pseudo-three-dimensional 
data, such as such as QuickTime VR data, of the target. 
By employing the method of the present invention, the 
25 problem of colors changing when the target is rotated 
and displayed can be avoided. 

[0247] As described, with the present invention, a real 
three-dimensional model of a target is automatically pro- 
duced. In particular, because the present invention em- 
30 ploys an ordinary passive camera, the image data of the 
target can be safely obtained. Moreover, by applying a 
coloring process, a real three-dimensional model which 
captures the characteristics of the target can better be 
obtained. 



Claims 

1 . A real three-dimensional modeling apparatus com- 
40 prising: 

an input section for inputting three-dimensional 
shape data of a target; and 
a formation section for forming a real three-di- 
45 mensional model from the obtained three-di- 

mensional shape data; wherein 
said apparatus produces a real three-dimen- 
sional model. 

50 2. A real three-dimensional modeling apparatus com- 
prising: 

a data input section for inputting image data by 
capturing a target from a plurality of directions; 
55 a modeling section for producing three-dimen- 

sional shape data based on the plurality of ob- 
tained image data; and 

a formation section for forming a real three-di- 
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mensional model based on the obtained three- 
dimensional shape data; wherein 
said apparatus produces a real three-dimen- 
sional model. 

5 

3. A real three-dimensional modeling apparatus com- 
prising: 

a data input section for capturing a target and 
inputting image data including color data; 10 
a modeling section for generating three-dimen- 
sional shape data and associated color data; 
a formation section for forming a real three-di- 
mensional model based on the obtained three- 
dimensional shape data; and is 
a color processing section for coloring the ob- 
tained real three-dimensional model based on 
said color data; wherein 
said apparatus produces a colored real three- 
dimensional model. 20 

4. A real three-dimensional modeling apparatus of 
claim 3, wherein said data input section inputs a plu- 
rality of image data. 

25 

5. A real three-dimensional modeling apparatus of 
claim 3, wherein said color processing section com- 
prises a color number reducing section for reducing 
the number of colors in the image data to a prede- 
termined number of colors. 30 

6. A real three-dimensional modeling apparatus of 
claim 3, wherein said color processing section com- 
prises: 

35 

application means for applying a photosensi- 
tive agent to a real three-dimensional model; 
and 

exposing means for exposing by projecting a 
predetermined pattern on said photosensitive 40 
agent based on said color data. 

7. A real three-dimensional modeling apparatus of any 
one of claims 1 through 3, wherein said formation 
section divides the three-dimensional shape data of 45 
target into a plurality of layers and forms layer-by- 
layer. 

8. A real three-dimensional modeling apparatus of 
claim 7, wherein . at said layer-by-layer formation , a 50 
plurality of sheets are processed based on the slice 
outline of the target. 

9. A real three-dimensional modeling apparatus of 
claim 7, wherein each of said formed layers is color- 55 
ed layer- by- layer, by a color processing section. 

10. A real three-dimensional modeling apparatus of 



claim 9, wherein said color processing section is a 
printer using an inkjet method. 

11. A real three-dimensional modeling apparatus of 
claim 9, wherein said color processing section ap- 
plies color using a photo-exposure method. 

12. A real three-dimensional modeling apparatus of ei- 
ther claim 1 or 2, wherein said formation section 
comprises: 

a sheet processing section for processing a plu- 
rality of sheets based on the slice outline of said 
target; 

a sheet layering section for layering the proc- 
essed sheets; and 

a color processing section for coloring the 
sheets to be processed according to the color 
of said target. 

13. A real three-dimensional modeling apparatus of 
claim 12, wherein said sheet processing section di- 
vides the obtained three-dimensional shape data 
into a plurality of sliced layer and processes the 
sheet corresponding to said sliced layer. 

14. A real three-dimensional modeling apparatus of 
claim 13, wherein said color processing section 
adds colors on the processing sliced layer of the 
sheet to be processed, the colors corresponding to 
the slice outline of said divided sliced layers. 

15. A real three dimensional model producing appara- 
tus of claim 7, further comprising: 

a shape template maintaining section for main- 
taining a shape template; and 
a shape template selecting section for selecting 
a suitable shape template based on the ob- 
tained three-dimensional shape data; wherein 
a real three-dimensional model is produced by 
adding formation material to said selected 
shape template. 

16. A real three-dimensional modeling apparatus of ei- 
ther claim 2 or 3, wherein said data input section 
comprises a plurality of cameras, each of which has 
its position fixed. 

17. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said data input sec- 
tion comprises a projector for projecting a predeter- 
mined pattern onto said target. 

18. A real three-dimensional modeling apparatus of ei- 
ther claim 2 or3, wherein said modeling section pre- 
pares a plurality of templates of predetermined 
shape for a work which is the processing target, and 
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produces a real three-dimensional model using a 
template resembling closest to the obtained three- 
dimensional shape data. 

1 9. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein 



mation corresponding to said print text string, 
wherein 

said formation section marks said real three-di- 
mensional model with said three-dimensional 
5 text based on said three-dimensional text infor- 

mation. 



said target imaged at said data input section is 
a person, and 

said formation section separately produces the 
hair portion and the face portion, and forms a 
real three-dimensional model by combining 
these. 

20. A real three-dimensional modeling apparatus of 
claim 1 9, wherein said hair portion and face portion 
are colored in advance. 

21 . A real three-dimensional modeling apparatus of ei- 
ther claim 2 or 3, wherein 

said modeling section obtains a three-dimen- 
sional shape data with the characteristic points 
exaggerated by extracting the characteristic 
points, and 

said formation section forms a real three-di- 
mensional model based on said three-dimen- 
sional shape data with the characteristic points 
exaggerated. 

22. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said formation sec- 
tion produces a real three-dimensional model with 
a thin thickness by shrinking the scale along the 
depth axis. 



27. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, further comprising: 

10 

a print text string input section for inputting a 
print text string, wherein 
said color processing section prints said text 
string on said real three-dimensional model 
15 based on said text string. 

28. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein 

a storing element is embedded on a real 
20 three-dimensional model to be produced. 

29. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said storing ele- 
ment comprises an input/output section for inputting 

25 data from or outputting data to another apparatus. 

30. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein a display element 
is mounted on a real three-dimensional model to be 

30 produced. 

31. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3 ; wherein a communication 
element is mounted on a real three-dimensional 

35 model to be produced. 



23. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said formation sec- 
tion forms a real three-dimensional model by mill- 
ing. 

24. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said formation sec- 
tion creates a formation mold and forms a real 
three-dimensional model using said formation 
mold. 

25. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, wherein said formation sec- 
tion is a 3D lithography device. 

26. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, further comprising: 

a print text string input section for inputting a 
print text string; and 

a three-dimensional text information reading 
section for reading three-dimensional text infor- 



32. A three-dimensional modeling apparatus compris- 
ing: 

40 a light projection section for projecting light; 

a light reflecting section for reflecting the light 
incident from said light projection section, for 
projecting a target; 

a capturing section for capturing image of the 
45 target where the light is projected; and 

a modeling section for generating three-dimen- 
sional shape data of said target based on the 
received light data. 

50 33. A three-dimensional modeling apparatus compris- 
ing: 

a data input section for inputting image data by 
capturing a target from a plurality of directions; 
55 a modeling section for generating three-dimen- 

sional shape data based on the plurality of ob- 
tained image data; 

a light projection section for projecting light onto 
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said target; and 

a light reflecting section for reflecting the light 
incident from said light projection section onto 
said target. 

34. A three-dimensional modeling apparatus of either 
claim 32 or 33, wherein said light projection section 
is a plane light source for projecting a pattern light. 

35. A three-dimensional modeling apparatus of either 
claim 32 or 33, wherein said light projection section 
is a spot light source for irradiating a beam light, and 
said apparatus further comprises, in addition to a 
light direction control section for changing the direc- 
tion of said spot light source, a light reflecting sec- 
tion for reflecting the light incident from said light 
projection section and projecting onto said target. 

36. A three-dimensional modeling apparatus of either 
claim 32 or 33, wherein said light projection section 
is a sheet-of-light source for projecting a sheet-of- 
light, and said apparatus further comprises, in ad- 
dition to a light direction control section forchanging 
the direction of said sheet-of-light source, a light re- 
flecting section for reflecting the light incident from 
said light projection section and projecting onto said 
target. 

37. A three-dimensional modeling apparatus, compris- 
ing: 

a light projection section for projecting light onto 
a target; 

a target image reflecting section for further re- 
flecting light projected onto said target and re- 
flected therefrom; 

an image capturing section for capturing said 
target image reflected at said target image re- 
flecting section; and 

a modeling section for generating the three-di- 
mensional shape data of said target based on 
the received light data. 

38. A three-dimensional modeling apparatus compris- 
ing: 

a data input section for inputting image data by 
capturing a target from a plurality of directions; 
a modeling section for generating three-dimen- 
sional shape data based on the plurality of ob- 
tained image data; and 

a reflecting section for reflecting said image of 
said target; wherein, image data of the image 
reflected at said reflecting section is input at 
said data input section. 

39. A three-dimensional data generating apparatus 
comprising: 



a data input section for inputting image data by 
capturing a target from a plurality of directions, 
wherein 

said data input section comprises a parameter 
5 setting section for allowing external setting of a 

data input parameter. 

40. A pseudo-three-dimensional data generating appa- 
ratus comprising: 

a data input section for inputting image data by 
capturing a target object from a plurality of di- 
rections, wherein 

said data input section comprises a parameter 
setting section for allowing external setting of a 
data input parameter. 

41. A three-dimensional data generating apparatus 
comprising: 

a data input section for inputting image data by 
capturing a target from a plurality of directions; 
and 

a modeling section for generating three-dimen- 
sional shape data based on the plurality of ob- 
tained image data, wherein 
said data input section comprises a parameter 
setting section for allowing external setting of a 
data input parameter. 

42. A three-dimensional data generating apparatus 
comprising: 

data input sections for inputting image data by 
capturing a target from a plurality of directions, 
wherein 

a portion of said data input sections comprises 
a data input reference parameter determining 
section for determining the reference value for 
a data input parameter and each of the other 
data input sections comprises a parameter set- 
ting section capable of setting a data input pa- 
rameter determined at said data input refer- 
ence parameter determining section. 

43. A pseudo three-dimensional data generating appa- 
ratus comprising data input sections for inputting 
image data by capturing a target from a plurality of 
directions, wherein 

a portion of said data input sections compris- 
es a data input reference parameter determining 
section for determining the reference value for a da- 
ta input parameter and each of the other data input 
sections comprises a parameter setting section ca- 
pable of setting a data input parameter determined 
at said data input reference parameter determining 
section. 
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44. A three-dimensional data generating apparatus 
comprising: 

data input sections for inputting image data by 
capturing a target from a plurality of directions; 
and 

a modeling section for generating three-dimen- 
sional shape data based on the plurality of ob- 
tained image data, wherein 
a portion of said data input sections includes a 
data input reference parameter determining 
section for determining a reference value for a 
data input parameter and each of the other data 
input sections includes a parameter setting 
section capable of setting a data input param- 
eter determined by said data input reference 
parameter determining section. 

45. A three-dimensional data generating apparatus of 
any one of claims 38, 41 , 42, and 44, wherein 

said data input section is a camera and said 
data input parameter is either a white balance pa- 
rameter or an exposure parameter. 

46. A pseudo three-dimensional data generating appa- 
ratus of either claim 40 or 43, wherein 

said data input section is a camera and said 
data input parameter is either a white balance pa- 
rameter or an exposure parameter. 

47. A real three-dimensional modeling apparatus of any 
one of claims 1 , 2, or 3, further comprising an ac- 
cessory display section for allowing a user to select 
an accessory. 

48. A real three-dimensional modeling apparatus of 
claim 47, further comprising a three-dimensional 
shape data modifying section for modifying the in- 
put three-dimensional shape data based on said se- 
lected accessory. 

49. A real three-dimensional modeling apparatus of 
claim 48, wherein said accessory is a pair of glass- 
es. 

50. A real three-dimensional modeling apparatus of 
claim 48, wherein said accessory is a hair style 
changing function. 

51. A real three-dimensional modeling apparatus of 
claim 48, wherein said accessory is a color assign- 
ment changing function for each part. 

52. A real three-dimensional modeling apparatus of 
claim 48, wherein said accessory is an ornament. 

53. A real three-dimensional modeling apparatus of 
claim 48, wherein said accessory is a shape pro- 



portion changing function for the real three-dimen- 
sional model. 
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